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Abstract 



V^J We study the Manneville map f(x) = x + x z (mod 1), with z > 

lf\ | 1, from a computational point of view, studying the behaviour of 

CT\ ■ the Algorithmic Information Content. In particular, we consider a 

family of piecewise linear maps that gives examples of algorithmic 
<^ | behaviour ranging from the fully to the mildly chaotic, and show that 

the Manneville map is a member of this family. 

1 Introduction 
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The Manneville map was introduced by Manneville in |JT7|, as an example 



of a discrete dissipative dynamical system with intermittency, an alternation 
between long regular phases, called laminar, and short irregular phases, called 
turbulent. This behaviour had been observed in fluid dynamics experiments 
and in chemical reactions. Manneville introduced his map, denned on the 
interval I = [0, 1] by 

f (x) = x + x z (mod 1) z > 1, (1) 

to have a simple model displaying this complicated behaviour. In Figure [I 
it is plotted the Manneville map for z — 2. His work has attracted much 
attention, and the dynamics of the Manneville map has been found in many 



other systems. We can find applications of the Manneville map in dynamical 
approaches to DNA sequences (Q,0|) and ion channels ([2(J), and in non- 
extensive thermodynamical problems (pj). 




Figure 1: The Manneville map f for z = 2 



The Manneville map has also been studied by Gaspard and Wang ( [jT3f| ) , 
using the notion of Algorithmic Information Content of a string, briefly ex- 
plained below. Given a dynamical system, any orbit of this system can be 
translated into a string a of symbols by a partition of the phase space of the 
system (symbolic dynamics). For any finite string a n of length n, it has been 
introduced by Chaitin (||) and Kolmogorov ([|HJ), the notion of Algorithmic 
Information Content (AIC) (or Kolmogorov complexity) of the string, that 
we denote by lAic(o~ n ), defined as the binary length of the shortest program 
p that outputs the string on a universal machine C, 



I A ic(o- n ) = {\ P \ \C(p) = a n }. 



(2) 



It is then possible, using the symbolic dynamics, to define the notion of 
Algorithmic Information Content for a finite orbit of a dynamical system. 
This extension requires some attention on the choice of the partition. The 



first results have been obtained by Brudno (||) using open covers of the 
phase space. Another possible approach, using computable partitions, is 
introduced in ||. 

To generalize the notion of AIC to infinite strings, it is natural to consider 
the mean of the AIC. We call complexity of an infinite string a the maximum 
limit of the AIC of the first n symbols of the string divided by n. Then, if 
we denote the complexity of an infinite string by K(a), we have 

^(a) = limsup /A/c(aW) , (3) 

where a n is the string given by the first n digits of the infinite string a. 
Symbolic dynamics is again the tool to define the complexity of an infinite 
orbit of a dynamical system. 

Moreover, we can ask whether it is possible to define a notion of infor- 
mation content for the dynamical system, without to consider any particular 
orbit. To do this, we have to introduce a probability measure /i on the phase 
space X of the system and we can define the algorithmic entropy h^ of a 
dynamical system by 

hf, = / K{x) d/i, (4) 

Jx 

where K(x) denotes the complexity of the orbit of the system with initial 
condition x e X. 

There exist some results connecting the information content of a string 
generated by a dynamical system and the Kolmogorov- Sinai entropy h KS of 
the system. 

First of all it is proved that for a compact phase space X and for an 
invariant measure /x, we have h^ = h^ s . Then in particular, in a dynamical 
system with an ergodic invariant measure fi with positive K-S entropy h^ s , 
the AIC of a string n symbols long behaves like lAic{o~ n ) ~ h^ s n for almost 
any initial condition with respect to the measure \x (0)- 

Instead, in a periodic dynamical system, we expect to find lAic(°~ n ) — 
0(\og(n)). Indeed, the shortest program that outputs the string o n would 
contain only information on the period of the string and on its length. 

It is possible to have also intermediate cases, in which the K-S entropy is 
null for all the invariant measures that are physically relevant and the system 
is not periodic. These systems, whose behaviour has been defined weak chaos, 



are an important challenge for research on dynamical systems. Indeed no 
information are given by the classical properties, such as K-S entropy or 
Lyapunov exponents, and in the last years some generalized definitions of 
entropy of a system have been introduced to characterize the behaviour of 
such systems (for example see ||21|| ). We believe that an approach to weakly 
chaotic systems using the infinite order of their AIC could be a powerful way 
to classify these systems (no information are obtained by the complexity and 
the algorithmic entropy defined as above). 

The Manneville map with parameter z > 2 is a non periodic map with 
null K-S entropy for all the physically relevant invariant measures, then the 
analysis of the AIC of the strings generated by the map is interesting. Gas- 
pard and Wang ( |13|| ) showed that the Manneville map exhibits a behaviour 
that they called sporadicity. Namely, the Algorithmic Information Content, 
lAic{& n )i °f a string n symbols long, behaves in mean like n a (log(ra)) /3 , with 
either 0<a<lora = l and (3 < 0. 

In this paper, we give a formal proof of the results obtained by Gaspard 
and Wang (|13[) for the Manneville map, giving more precise estimates for the 
AIC of a string generated by the map. But the most important generalization 
is that we find our results for the Manneville map as a particular case of a 
general theorem concerning a large family of maps L, defined in equation 
(^). This family of maps exhibits an extremely wide range of behaviours 
(for the AIC of the generated strings), and sporadicity is only one possible 
case. Then we find a family of maps that can be classified with respect to 
the order of the AIC of a "typical" (in the sense of Lebesgue measure) initial 
condition. Moreover we study some topological and metric properties of the 
maps L, useful to obtain a prediction of the behaviour of the AIC of the 
related symbolic dynamics (see Section ^j. 

In Section [2], we introduce the family of maps L, and show how the 
Manneville map / can be thought of as one member of the family. 

In Section |^, we study the maps L from the topological point of view. In 
Section |] we show that the maps in the class L are equivalent to a Markov 
chain in a suitable sense. This equivalence is extensively used in Subsection 
|5.1| , where we present our results relative to the behaviour of the AIC of the 
strings obtained from the maps L. 

Finally, in Subsection |5]^, we study the computational aspect of the maps 
L from a practical point of view. So, we restrict ourselves to consider the 
Lebesgue measure I on the interval I. 



2 The family of piecewise linear maps L 

In this section we present what we shall use as our formulation of the Man- 
neville map ([!]) . In the following, we study a family of piecewise linear maps L 
on the interval I = [0, 1], which are topologically equivalent to the Manneville 
map /. Using the maps L, all the theorems have an easier interpretation and 
computations can be done exactly. Moreover all our results are extendible 
through metric isomorphism, hence we shall define on the interval /, two 
different measures that make the topological equivalence between L and / a 
metric isomorphism. Then we can extend all the results that we find for the 
maps L to the Manneville map /. 

Let's start defining the piecewise linear maps L that we consider. We use 
here the same approach as in [ Yl\ . A natural way to get a partition of the 
interval I — [0, 1] from the Manneville map / is the following: let's call xq 
the point of I such that /(x ) = 1 with x ^ 0, 1, and x\ the preimage of x Q 
in the interval [0, x ]j then we define recursively x n = {f~ 1 (x n -i)}n [0, x n _i]. 
Then the sub-intervals B^ = (xk,Xk-i\, for k > 1, and B = (x , 1] are a 
partition of /. 

Define {efc}fceN a sequence of positive real numbers, that is strictly mono- 
tonically decreasing and converging towards zero, with the property that 

r/ '" J _f// <1 VfcGN. (5) 



Cfc-2 — Cfc-1 

The piecewise linear maps that we consider are defined by 

e -7fr^r ( x ~ e fc) + e fc-i e k < x < e fc _i, k>l 

c fc — 1 c k 

L(x) = { fE| e <x<l (6) 

x = 

where we define e_i = 1. These piecewise linear maps L clearly depend 
on the definition of the sequence {efc}fc G N, but a particular choice for this 
sequence is important only for Section ||]. For the moment we consider any 
possible sequence, with the properties specified above. Let's define sub- 
intervals Ai = (e*, ej_i], and Aq = (eo, 1]. These interval form a partition of 
the interval /. We prove the following 

Theorem 2.1. Any piecewise linear map L defined as in equation (j6[) is 
topologically equivalent to the Manneville map f . 



Proof. We have to find a homeomorphism h : I — » / such that h(f(x)) = 
L(h(x)) for each x G /. To find such a homeomorphism we use the partitions 
(Bj) and (A,). We define h(x n ) = e n for each n G N and h(0) = 0, /i(l) = 1, 
and such that h(Bj) = Aj, for all j > 0. To define the homeomorphism h 
we use a dense set of /, define h on this set and, then, simply extends the 
definition of h to the whole interval I by continuity. 

Let's consider a sub-interval B k . By definition of the Manneville map /, 
we have that f(Bk) = B k -i, for k > 1, and /(-Bo) = ^- Then it follows 
that f (B k ) = Bq and f k+l (B k ) = I. So, within each Bk we can find 
sub- intervals B k j, with k,j G N, defined by f k+1 (B k j) = Bj. These sub- 
intervals form a partition of each B k . We can continue this partition of 
the intervals B k , defining, by the same rule, sub-intervals B k ji that form 
a partition of B k j. We write then any sub-interval of the form Bk 1 k 2 ...k„, 
with ki G N for each i = l,...,n, as B kl k 2 ...k n = ( y Xk 1 k 2 ...k n ,Xk 1 k 2 ...(k n -i)]- 
The set {xk 1 k 2 ...k n i n EN, ki G N} is a countable dense set of the interval i". 
Analogously, we can define a set of points {e^^...^, nGN, ki E N}, for the 
map L, with the same property as Xk 1 k 2 ...k n - We define then h(xk 1 k 2 ...k„) — 
£kik 2 ...k n for each n G N, and extend the function h continuously to the 
whole interval /. We have thus obtained a continuous function h such that 
h{B kl k 2 ...k n ) = A kl k 2 ...k n , for each n G N, where the sub-intervals A klk2 ,„ kn are 
defined as A klk ^„ kn = {e klk2 ,,, kn - ! £k 1 k 2 ...(k n -i)\- 

The injectivity of h follows by contradiction. Let's suppose to have two 
points x < y <E I such that h(x) = h(y) = z. By the density of the set 
{x klk2 ... kn) n G N, ki G N}, we can find a point x kl k 2 ...k n £ {%, y)- This implies 
that there exists a n such that x G B klk2jyk -_i) and y G B klk2 ... kn . Then we 
have /i(x) t^ /i(y). The subjectivity of h follows immediately by the definition. 

Then the inverse function h~ l exists and h is a homeomorphism because it 
is a continuous invertible function from a compact to a Hausdorff space. □ 

The topological equivalence between L and / can be used in particular to 
obtain a metric isomorphism. If we have a measure \x on the interval (J, B, L), 
where B is the Borel a-algebra, then the homeomorphism h carries // into 
another measure v = h*fi on (J, B, /), and with respect to these measures h 
is a metric isomorphism. 

Theorem 2.2 (Radon-Nikodym). Given two measures \x andv on (I,B), 
such that (I, B, v) is a-finite, \x << v if and only if there exists a real function 
f on I, integrable with respect to v on all sets B G B such that v{B) < +oo 7 
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satisfying the following condition for every B G B: 

li(B) = f fdu 

J B 



Theorem 2.3. If the measure // on (I, B, L) is absolutely continuous with 
respect to the Lebesgue measure I (ft << I), then also the measure is = h*fi 
on (I, B, /) is absolutely continuous with respect to the Lebesgue measure I, 
and vice-versa. 



Proof. We can apply Theorem [T2]to the measures \x and I. Then we obtain 
a real function / M on /, integrable with respect to I and such that for all 
B eB 



Kb) = [ U dL 

JB 



By definition of the measure is, we have that is(B) = fi(h(B)) for all 
B E B, then 

is(B)= [ f,dl= [{^oh)(dh)dl, 

Jh(B) JB 

where dh is defined almost everywhere with respect to I, being h a monotone 
continuous function. Then we have found a function /„ = (f^oh)(dh), which 
satisfies the hypotheses of the Radon-Nikodym Theorem. Then is << I. 
The vice-versa is proved in the same way. □ 



At this point, thanks to Theorem 2.3, we can use our linear map in all 



our applications of topological and metric methods. 

3 The topological approach 

In this section we start a procedure of equivalences of the maps L with well- 
known maps, that can be used to establish the results of Section |5|. The first 
step is to study the relationship between the maps L and a sub-shift of finite 
type. 



3.1 Symbolic dynamics 

We briefly recall the definition of a sub-shift of finite type. Let's consider 
a finite set of symbols S = {0, 1, 2, ... , N}, with N > 1, and build a set 
T, N = S N as the product of countable factors S. On T, N it is defined a map 
T, called the shift map, that acts on the elements of H N , by shifting forward 
the indexes. Namely, if o = (o- Q o~i . . . a n . . . ) G T, N , with <Tj G {0, . . . , iV} for 
all J6N, then T(a) = {o~\ . . . a n . . . ). The set T, N is endowed with a metric 
d defined by 



S„ 



^-') = E^ 



ra=0 



where 5ij is the Kronecker symbol, that makes it a compact space. A sub-shift 
of finite type is obtained from the set (E N ,T), by means of a (iV + 1) x (iV+1) 



matrix M 
all i,j = 0, 



771 
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called the transition matrix, such that m^ G {0, 1} for 



iV. We define a subset E^ of E , by 






{aG E 



iV 



m n 



lVieN}, 



then a sub-shift of finite type is simply the compact, metric space (T,^,T M ) 
(see 



0)- 
We have 



Theorem 3.1. For any N > 1, there exists a particular transition matrix M 
such that any map L of the family of piecewise linear maps (Qj is a factor of 
the sub-shift of finite type (Ej^, Tm)- This means that there exists a subjective 






I such that ii o T, 



Al 



L O TV. 



continuous map ir 

Proof. Let a (iV + 1) x (N + 1) matrix M be defined by 



M 



/111 
1 
1 



\ 







1 1 1 \ 










1 1 



/ 



(7) 



we show that this is the matrix we need. 

Let's consider a partition of the interval / defined by using the partition 
Ai = (e», 6j_i], introduced in Section [| From this partition we obtain a 



partition of the interval /, by Bi = A{ for i = 0, . . . , N — 1, and B^ = 
{0} U (u^jyA,) = [0, 6jv-i). From this partition and by using the properties 
of any of the map L, we obtain a (N + l)-nary representation of the interval 
/. 

The (iV+l)-nary representation of a point x G / is given by a string a such 
that L n (x) G -B(j n with o~ n — 0, . . . , N, for any nGN. This representation is 
nothing else that a map tt : Y, N — > /. Hence we just need to show that this 
map 7r is continuous and subjective, and verifies the commutation rule with 
L and T. 

First of all we notice that our map tt is not defined on the whole space 
H N , because of the restrictions given by the particular form of the map L. If 
we want to reduce the space E , we have to consider a transition matrix M, 
and we use the matrix M defined in equation (|7]). It is easy to verify that 
for any a G T> M there is a point x G / such that tt(<t) = x. Then we show 
that n : Ej^ — ► I is a subjective continuous map such that ix o Tm = L o tt. 

We have then a semi- con jug acy between our piecewise linear maps L and 
symbolic dynamics. We have not a conjugacy because of the lack of injectivity 
of the map n. Indeed, as in any n-ary representation of the real numbers in 
the interval / = [0, 1], there is a countable set X of points that are images 
of two sequences. Moreover, in our case, these points can be characterized 
by the property that for any x in this set there exists a iV G N such that 
L N {x) = 1. 

Commutation. The commutation rule ir o Tm = L o tc is an immediate 
consequence of the definition of tt. 

Subjectivity. It follows immediately from the definition of the map tt. 

Continuity. We have to prove that given any e > there exists a 5 > 
such that if d(<Ji,o~2) < 5 then (^(cr 1 ) — 7r(cr 2 ) | < e. But from the definition 
of the metric d on the space Ej^, we have that d^a 1 ^ 2 ) < 5 is equivalent 
to: there exists a K > such that <r| = <j| for all j = 0, . . . , K. So given 
any e > we have to find a K > such that a^ = <r| for all j = 0, . . . , K 
implies (^(a 1 ) — 7r(cr 2 ) | < e. From the definition of the map tt it is clear that 
if a ) = a] for all j = 0, . . . , K for any K > 0, then D(tt(o- 1 )) and L^Tr(a 2 )) 
belong to the same subset B a i of the partition (Bi) for all j = 0, ... , K. 
Then, if we consider a partition of the subset B a i, given by (-B .i)j 1 j 2r ..j n , 
with ji — 0, . . . , N for all i, where L r ((B a i )j 1 j 2 ,...j n ) = Bj r for all r — 1, . . . , n, 
we have that diam^B^)^^^,,^^ — > as n — > +oo, thanks to the particular 
form of the map L. This argument gives the continuity of the map n. □ 



We can extend Theorem |3.1| to the case of N = oo. The space E = E°° 
is defined in the same way, but we cannot extend the metric d, defined as 
before, and we can only define a topology on E, where the open balls are 
the same as before. In this case E is not anymore a compact space. The 
transition matrix M is oo x oo dimensional and it is defined by 



M 



( 1 

1 




y ... 



1 1 



1 
1 



1 







1 1 









\ 



/ 



(8) 



On the space Ejv/, we define then a map Tm, given by the forward shift. 
Then we can prove 

Theorem 3.2. Any of our maps L on I is a topologically conjugate to the 
dynamical system given by (Ejy, Tm) built on countable symbols and transi- 
tion matrix M given by equation (^). 



Proof. The proof is the same as in Theorem |3.1| . The difference is that now 
we obtain a conjugacy with the set Ea/, thanks to the fact that the matrix 
M, being infinite, exactly simulate the dynamics of the piecewise linear maps 
L from a topological point of view. □ 



3.2 Topological and Kolmogorov- Sinai entropy 

The semi-conjugacy of the maps L with the symbolic dynamical system on 
finite symbols is useful to compute some topological and metric quantities of 
our map. Indeed the lack of injectivity of the map n is on a set that doesn't 
change the dynamical richness of the systems. In this subsection we compute 
the topological entropy and the Kolmogorov- Sinai entropy for some measures 
(see 



From the theory of dynamical systems, we know that the following theo- 
rems hold (see [|14]1 ): 



Theorem 3.3. The topological entropy is invariant for topological equiva- 
lence. 

Theorem 3.4. The topological entropy h top of a sub-shift of finite type is 
logA max , where A max is the largest eigenvalue of the transition matrix. 
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Then we have just to compute the eigenvalues of the transition matrix M 
on finite symbols defined in equation (0), and then, thanks to the previous 
theorems, the topological entropy h top {L) of our linear map L is given by 
logA max . For any N, we find that A max = 2, then h top (L) = log 2, for any 
possible sequence (e&) defined as before. 

At this point we start to consider measures on the space EjJJ-. We have 
to introduce first a a-algebra C. We take as a basis of C the sets of the form 

C? = {aeY, N M |«r i = r i Vi = 0,...n}, (9) 

for any n G N and r G S' n+1 . These sets are called cylinders. At this point 
we use a classical result of dynamical systems (see fl6|l ): 



Theorem 3.5 (Variational Principle). Given a continuous map f : X — > 
X of a compact metric space X , the topological entropy h top {f) is the maxi- 
mum of the K-S entropies h v {f) on the set of all the f -invariant probability 
measures v on X . 

Then we look for the probability measures v on Ej^ with K-S entropy h^ s 
equal to log 2. For sub-shift of finite type, a particular class of Tjvf-invariant 
measures are defined by a stochastic matrix associated to the sub-shift. These 
measures are called Markov measures, and among them there is a measure 
that maximize the K-S entropy. This measure is called Parry measure, and is 
denoted by ^n (see [ i 4| ) . This measure is defined by a particular choice of the 



stochastic matrix II. In words, the Parry measure represent the asymptotic 
distribution of the periodic orbits, that is if C is a cylinder in Ej^, we have 
that 

(r ,s r periodic orbits of period n contained in C 
n-»oo all the periodic orbits of period n 

We compute the Parry measures for some N, then we define on / the 
induced measure /in = 7rVn, to obtain an L-invariant probability measure 
on I of K-S entropy h^(L) = log 2. 

For N = 1, we have that ^n(Cg) = M^f) = \- So M s o) = A*n(#i) = §■ 
For any N, we obtain 

M B i) =2^r i = 0,...,iV-l 
/^[(-Bat) = ttn^t 
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So for the limit iV — > oo (where we directly have topological equivalence 
between (I,L) and (E^T^-)), we obtain /i n (-Bj) — A*n(A) — ^tt- We nave 
thus found a countable family of L-invariant measures on / with K-S entropy 
log 2. 

4 The metric approach 

We start now to consider what happens if we start from our interval /, 
endowed with a probability measure /i on the Borel a-algebra B, and with 
the dynamics induced by the maps L. In particular we show that we obtain 
an equivalence with a Markov chain that will be useful for the computational 
approach (Section^). 

From our space (I, B, L, /x), where we remark that we haven't supposed \x 
to be L-invariant, we have a metric isomorphism with the space (Ejy, C,T m ) 
on countable symbols, with the probability measure P = 7r*/i induced by the 
homeomorphism ir found in Theorem |3.2| . 

At this point we use some notions and results introduced by Parry |18| . 



Definition 4.1. A non-atomic stochastic process is (A, A, T, m) where A = 
{x — xo,xi,... | xi G N Vz G N}, A is the cr-algebra generated by the 
cylinders C™, m is a non- atomic probability measure on A, and T is the 
forward shift on A. In the theory of stochastic processes the transition 
matrix M on Tim is called a structure matrix. 

Definition 4.2. A stochastic process is called transitive of order k if for all 
(xi,..., x k ) and (y h ...,y k ) with m(x 1 , . . . , x k ) > and m(yi, ...,y k )>0, 
there exists a finite (zi, ... , z n ) such that 

m(xi, . . . , x k ; z u . . . , z n ; y x , . . . , y k ) > 0. 

When k — 1, a stochastic process is simply called transitive. 

Definition 4.3. A stochastic process is said to be intrinsically Markovian 
of order k if m(xi, . . . , x n ) > and m(x n _ fc+1 , . . . , x n+ i) > imply 

m(xx,...,x n ,x n+1 ) > 0. 

When k — 1 it is simply called intrinsically Markovian. 
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We can easily prove 

Proposition 4.4. Our space (Em, C, Tm, P) is a non-atomic stochastic pro- 
cess, which is transitive and intrinsically Markovian. 

Definition 4.5. Given a stochastic process (X, A, T, m), a measure p makes 
the process (X,A,T,p) compatible with the original when p(C") > if and 
only if m(C™) > 0, for any cylinder C™. 

At this point we use the notion of non-atomic stochastic processes to 
obtain a compatibility between the maps L and a Markov chain, through 
the symbolic dynamical system on countable symbols. Before giving the 
theorems in this direction, we briefly recall the theory of Markov chains (see 



Definition 4.6. Given a probability space (A,J-,P) and a countable space 
Y with the discrete a-algebra, a Markov chain is a sequence (Z n ) nG N of 
random variables Z n : A — > Y such that 

i) If, given y , . . . , y n+1 e Y, we have P[Z n = y n , Z n ^ = y n _i, . . . , Z = 
y ] > 0, then 

P[Z n +i = 2/n+i | Z n = y n , . . . , Zq — yo] = P[Z n+ i = y n +i \ Z n = y n ], 

ii) If x, y G Y and m,n6N are such that P[Z m = x] > and P[Z n = 
x] > 0, then 

P[Z m+1 = y | Z m = x] = P[Z n+1 = y \ Z n = x\. 

In particular the numbers p(x, y) = P[Z n+ i = y \ Z n = x] form a matrix 
II = {p{x,y)) x ^ y( zx, called the transition matrix. Moreover the probability 
measure on Y defined by v(y) = P[Z = y] is called the initial distribution. 

The transition matrix II is a stochastic matrix, that is p(x, y) > and 
YjyaxP&iV) = l for a11 x e Y ■ 

Theorem 4.7. Given any countable space Y , a transition matrix II and an 
initial distribution v, it is possible to construct a probability space (A, J 7 , P) 
and a sequence of random variables Z n : A — > Y , such that the constructed 
Markov chain has II as transition matrix and v as initial distribution. 
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Proof. For the proof of the theorem see Chung |J. We simply say what is 
the constructed probability space (A, J 7 , P). The space A is Y n and is called 
the realizations space, the a-algebra T is given by the cylinders defined as in 
equation (|9|), and the probability P is defined on the cylinders by 

P(C™) = v(r )p{r , ri)p{rx, r 2 ) ■ ■ .p(r n _ir n ). 

The random variables are defined as the projections of A on Y . □ 

Theorem 4.8. Given any intrinsically Markovian, transitive stochastic pro- 
cess (X,A,T,m) and a stochastic matrix IT such that p(i,j) > if and only 
if TUij = 1, for the structure matrix M of the process, there is a probability 
p on X such that (X,A,T,p) is compatible with (X,A,T,m), and it is a 
Markov chain with U as transition matrix. 



Proof. We have just to apply Theorem [O] to the matrix II and to an initial 
distribution z/, being X already in the form of the realizations space. The 
probability p is then the probability P defined as above. □ 

Corollary 4.9. Our space (S M , C, T M , P) is compatible with a Markov cha- 
in. 



Proof. The corollary is proved thanks to Theorem WM and Proposition [0 



We have just to choose a stochastic matrix that satisfies the hypothesis, that 
is p{i,j) > if and only if rriij = 1 for the structure matrix defined as in 
equation (B). The measure P can be used as initial distribution. □ 



We have thus completed our equivalence, in the sense of Corollary 
between the maps L defined on the space (J, £>, /i), for any probability mea- 
sure /i, and a Markov chain, that is denoted simply by a stochastic matrix 
II and an initial distribution v. 



5 The algorithmic entropy 

The results of Section f| are useful for the computational approach to the 
Manneville map / defined by equation ([!]). As remarked before, also in this 
section we shall restrict ourselves to the AIC for the maps L, which are 
equivalent to the Manneville map / in the sense described above. Using this 
restriction it is possible to perform explicit computations which, by Theorems 
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and Z3, can be extended to the Manneville map /. The investigation on 
the maps L that we present in this section is meant to be a generalization of 
the work of Gaspard and Wang on the Manneville map (see [|13j ) . 

Given our dynamical system (/, B, L, //), where \x is any probability mea- 
sure on the Borel a-algebra of the interval /, we translate the orbit of a point 
x G I into a string a = n(x) G Sjy, with the transition matrix M given in 
equation (§), and study the AIC of the string. 



5.1 General results 

In Section |], we proved that for any map L our dynamical system (J, B, L, /x) 
is equivalent, in a sense specified above, with a Markov chain with a stochastic 
matrix II defined by means of the transition matrix M of equation (§[), and 
a given initial distribution that can be considered to be the measure /i itself 
(see Corollary |4J|) . We remark that it is not necessary to choose the measure 
fj, on I to be L-invariant. Now, we want to relate the dynamics of the Markov 
chain with our dynamical system. A natural choice for the stochastic matrix 
ITis 



n 



/ 



V 



Po 


Pi 


P2 ■ 


■ Pn 


Pn+1 


Pn+2 ■ ■ ■ 


1 
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■ 





••• 
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■ 


• 





••• 








1 • 


• 





••• 



\ 



/ 



(10) 



where pi are the probabilities of transition from the sub-interval Aq to the 
sub- interval Ai, and in terms of the measure /i are given by 

niAoHL-^Ai)) 



Pi 



MA 



(ii) 



It is evident in the definition of II the dependence on the particular se- 
quence (efc) that we consider to define the map L and on the probability 
measure \i. 

It has been shown by Gaspard and Wang ([pi), that a way to estimate 
the AIC of a string obtained from our dynamical system is the theory of 
recurrent events applied to Markov chains (JTlfJlOfl). From the theory of 
Markov chains, we have that our stochastic matrix II is irreducible, and that 
the state A$ is persistent, in the sense that 

p[Z m = for some m > n\Z n = 0] = 1 V n, 
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where p is the probability measure on (T> M ,C,T M ) that makes it a Markov 



chain with (Z n ) as random variables from S^ to N (see Theorems [O , 4.8). 

If we consider as recurrent event £ the passage from the sub- interval Aq, 

we have that £ is certain and that the mean recurrence time mo is given by 

+00 

m o = ^2 k Pk-\- (12) 

fc=l 

If mo = +00 the state A is called null, otherwise it is ergodic. Thanks 
to the irreducibility of the stochastic matrix II, we have that all the states 
Ai are of the same kind of Aq, and then either rrn = +00 for all % E N or 
rrii < +00 for all ieN. 

For the recurrent event £ two random variables can be introduced: X^ : 
Tim — > N given by 1 plus the number of trials between the (& — l)-th and k-th 
occurrence of £\ N k : Dm — ► N given by the number of realizations of £ in 
k trials. The random variables X^ have all the same probability distribution 
given by 

p[X k = r] =Pr-l, 

and their mean i? p [Xfc] = mo, where the subscript p specifies the measure we 
use to find the mean. For our problem it will be very important also the form 
of the distribution function F(x) = Ylr=oP r °f ^ ne -^h- Finally, we consider 
also the probabilities u n that £ occurs at the n-th trial. It holds that 

lim u n = — . (13) 

Let's now explain the link between the AIC of a string generated by the 



map L and the theory of recurrent events ([13]). Given an initial point x E I 
we obtain a string a E Em such that L k (x) E A Uk for all k E N. The string 
a is, for example, of the form 

a = (7654321054321002103210 . . . ). (14) 

One possible way to give an estimate for the AIC of the string is to 
consider a compression of the string, and study the binary length of the 
compressed string. One possible compression of the string a is given by 

S= (75023...), (15) 
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that is the sequence of recurrent times for £. So to the finite string a n , 
obtained by the first n symbols of a, we associate the string 



?"»_,„ „ , 0n 



with Gq,-\ = for all i, where N n is the number of realizations of £ . Then 
to have an idea of the behaviour of the AIC of a string we have to estimate 
the behaviour of the random variables N n . 

In [JT0|1 , some possible behaviours for E p [N n ] have been studied, for par- 
ticular forms of the distribution function F(x). In particular 

Theorem 5.1 (Feller). If the recurrence time of £ has finite mean m and 
variance V , then 



E p [N n ] + 



n V — ITiQ + 772 



mo 2r?7,Q 

//, instead V = +oo, and the distribution function F(x) satisfies 

F(x) ~ 1 - Ax- a 

with a constant A and < a < 2, then: 
i) If 1 < a < 2, 



E p [N n ] + 



n A 



n 



m ' (a — 1)(2 — a)ml 
ii)IfO<a< I, 

„ r , T , sina7r „ 

E ^ ~ -AST* ■ 

If the variance V of the recurrence time is infinite but the distribution 



function has a form different from that studied in Theorem |5.1] , then we can 
show that 

Theorem 5.2. If the state A is ergodic then E p [N n ] ~ /en, if instead A is 
a null state then E p [N n ] is an infinite of order less than n. 
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Proof. The proof is based on a characterization of the mean E P [N n \. In [TD 
it is shown that E p [N n ] = U n — 1, where 



«. = E 



n 

Ui. 
j=0 



Then it follows that 



,. E p [N n ] U n 1 

hm = hm — = hm u n = — . 

Then, if m-o < +00, that is A is ergodic, then E p [N n ] is linear on n. 
Whereas if rriQ = +00, that is A is a null state, then E p [N n ] is an infinite of 
order less than n. □ 

The AIC calculated with the compression we have chosen can be linked 
to the random variables N n by the following theorem 

Theorem 5.3. For any string o~ G Xju it holds 

(N n - 1) + log 2 (n - N n + 2) < I A ic(o- n ) < N n log 2 I ^^ J (16) 



Proof. Given n G N, we have that Em = UC™, where the union is made on 
all the possible cylinders C™, with r G W 1 . Moreover we write 

W<x n ) = $>g 2 K + 2) 

i=l 

for the AIC, where a q . + 2 is used instead of a q ., to have log 2 (cr g . + 2) > 1 
for all i. 

First of all, we consider only the cylinders C™ with r n = 0. This is done 
because we want to study the strings whose compression changes when we 
increase our given n. Indeed, if the compression wouldn't change, we wouldn't 
have any hint on the behaviour of the AIC with respect to the length of the 
string. 

We start with some special cases. Let's consider first the case N n = 
n. The only possible cylinder is then C" with r = (0, ...,0). Then our 



compression doesn't change any string in this cylinder, and iAici®" 1 ) = n f° r 
any string. 

In the case N n = (n — 1), the possible cylinders are given by r 6 N" with 
only one symbol 1 and all the others 0. For all the strings in these cylinders, 
the compression is (n — 1) symbols long, and lAic(& n ) — (n — 2) + log 2 3. 

In the case N n — 1, the only possible cylinder is given by r; = (n — i), 
and for the strings in this cylinder lAic(°' n ) — log 2 (n + !)• 

Let now be in general N n = n — h, for some h < n. The compression of 
such strings is then iV n -symbols long. Moreover the compression is such that 
Yli=i a q = h. We now want to find the maximum and the minimum of the 
function 

J>g 2 K + 2) 

with the condition Ylii=i a q = k- The maximum is attained for equal a q , ^ 0, 
and the minimum for all the a q = but one which is equal to h. Then the 
maximum is given by a q . = ^^ for all i, and the AIC for the strings in 

such a cylinder is given by XT=i 1°S2 (^ + 2 ) = N n^og 2 f 11 ^ 2 -), and the 
minimum is given by (n — h — l) + log 2 (/i + 2) = (N n — 1) + log 2 (n — N n + 2). 
Looking back at the special cases we studied before, we see that for N n = 
n and iV n = 1, the maximum and the minimum are the same, and give 
exactly the value of the AIC we found building the sequences. For the case 
N n = (n — 1), the only possible value for the AIC is equal to the minimum we 
found. This shows that the maximum is not attained always, but there are 
cases in which it is attained. For example let n = 8, N n = 4, and consider 
the string a = (10101010). Its compression is then given by S = (1111), and 

I A ic(v n ) = 4 log 2 3 = N n log 2 (agk) . 

Finally we remark that we have tacitly assumed that our strings do not 
begin with the symbol 0. If it happened, the estimates wouldn't change 
significantly. 

We have thus proved that for a subset of Em of full measure with respect 
to all the cylinders with as last symbol, the AIC of a string can be estimated 
using the value of the random variables N n . □ 

Then our plan is the following: given a probability measure /i on (J, B, L), 
we find the stochastic matrix II, equation (0), the distribution function 
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F(x), and, the mean E p [N n ]. Then we can link the mean E fJi [lAic{o' n )], 
where \i is the probability measure on (1,13), with the mean E p [N n ], by 



Theorem 5.3 



Another important aspect is the existence of an invariant measure for the 
Markov chain associated to our dynamical system. Given a stochastic matrix 
II of the form of equation (|T0|) we have 

Theorem 5.4. There is a measure p on the space (T,m,C,Tm), invariant for 
the stochastic matrix H, defined by 



p( k ) = Yl pk+n - 



n=0 



This measure is a probability measure if and only if the mean recurrence time 
m is finite. 

This theorem allows us to induce on (I, B, L) an L-invariant measure jl, 
which is a probability measure if and only if A is ergodic. 

5.2 Restriction to the Lebesgue measure 

In the previous subsection we have shown that given a probability measure \x 
on the space (I, B, L), we have that the mean of the AIC behaves differently 
according to the mean recurrence time of the passage for the sub-interval 
Aq. These results clearly depend on the choice of the measure /i and of the 
sequence (e&) used in the definition of the map L. In this subsection we want 
to study these two problems from a practical point of view. 

When we apply the notion of AIC to a string obtained from a dynamical 
system, the choice of this string depends on the choice of the initial point 
x which we use to generate the orbit of the dynamical system. This choice 
can be made randomly, and the most natural way to introduce a probability 
distribution on the choice of the initial point is by using the Lebesgue measure 
I on the space. Hence we apply the results of Subsection [TT] to the system 
(1,13, L, I). Using the Lebesgue measure /, thanks to the piecewise linearity 
of the map L, the probabilities of transition pi given in equation ( |TTD assume 
a particular simple form. Indeed we find that pi = l(Ai) for all i£N. 

With respect to the Lebesgue measure I, it is also possible to prove that 
the compression we have introduced for strings given by any map L is the 
best possible. We have 
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Theorem 5.5. Given any piecewise linear map L of the form (fQ), the best 
compression for the strings generated by the dynamical system (I,B,L,l), 
where I is the Lebesgue measure, is the compression given in equations ftLjp 
and ftT3{), for l-almost any initial condition. 

Proof. The compression we introduced gives a bijective relation between 
our space (E M , C, T M ,p) and the space of all possible infinite sequences built 
on countable symbols, without any restriction given by a transition matrix. 
We denote this space as E. We introduce on E the cr-algebra of the cylinders 
C r n , given as in equation (|S]), and a probability measure p' inherited in some 
way from p. We define p' by 

pxc'n = p{c N R \ (17) 

where the cylinder C^ is built in such a way that compression of strings that 
belong to it gives strings belonging to the cylinder C r n . At this point we ask 
if it is possible to compress any more strings belonging to the space (E, C, p'). 
But, if on this space we consider the usual shift map, we find a p'-invariant 
map with positive K-S entropy h KS '. This is given by a direct computation, 
using the piecewise linearity of the map L that gives a simple form for the 
measure p' . Then it is well known that the AIC for this dynamical system 
behaves like h KS n, for p'-almost any string a, then for /-almost any initial 
condition x e /. This clearly implies that for /-almost any initial condition 
x E I, ours is the best possible compression. □ 

Remark 5.6. According, for example, to Brudno's approach (|J) to obtain 
a definition of AIC for finite orbits of a dynamical system, we should evaluate 
the supremum of lAic{o~ n ) varying the open covers of the interval I = [0, 1]. 
Theorem ^T2] can be established as well if we consider an open cover of the 
form Ai = (e», e$_i + rji) for < ^ << 1. Theorem |57| suggests that the AIC 
of any sequence generated by the system (J, B, L) with a non-trivial open 
cover has to be related to the random variables N n as in the case we are 
considering. Then we can prove that the AIC of the particular strings we 
are considering is the AIC of the dynamical system (J, L). This can also be 
proved in a more general contest ( ||1 2|| ) . 



The second point is the choice of the sequence (e^). We know that for 
any sequence, we can find an isomorphism of the map L with the Manneville 
map / of equation (|Ij). At this point we present some cases for the choice of 
(e&), and then study a particular choice. 
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Example 5.7. Let the sequence be given by e^ = -^ with a > 0. This 
sequence has all the properties we need for the definition of the map L. 
Then 

Pi = 1(A) 



(i-l) a i a i a+1 
The mean recurrence time m is given by 



m = \^ r p r _ 



r=l 



and it is finite if and only if a > 1 . Then we can find an invariant measure p, 
for the system (J, B, L), such that p,(Ai) ~ -^. This measure \x is a probability 
measure if and only if a > 1. 

The variance V^ of the recurrence time is given by 

+oo 

V = ^ r 2 p r _i 

r=l 

and then V < +oo if and only if a > 2. If we compute the distribution 
function F(x), we have that 

F(x) ~ 1 - AaT Q , 

then we can apply Theorems |5J] and |5.3| , and obtain that: 

i) if a > 1 then ^[/ A/C (a™)] ~ E P [AT„] ~ n; 

ii) if a < 1 then E p [N n ] ~ n a and n a < Ei[I AIC ((T n )} < n a \og 2 n (see 
Theorem 5.3). 



Example 5.8. Let now the sequence (e^) be given by e^ = -tj, where oGN 
and a > 1. In this case it is easy to verify that p^ ~ -j. Then the mean 
recurrence time mo and the variance V of the recurrence time are always 
finite, and we can deduce that Ei[I Aic{.o n )] ~ E p [N n ] ~ n. The invariant 
probability measure p exists and is given by Jx(Ai) 



i 

r\j r 
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Example 5.9. Finally let's consider the case in which the sequence (e^) is 
given by e^ = kct ,^ k ^ with either a = 1 and j3 > 1 or a > 1. If we compute 
the variance V of the recurrence time, we obtain that it is finite if and only 
if either a > 3 or a = 3 and (3 > 1. In this case we obtain from Theorem |5J] 
that Ei[I Aic{ff n )\ ~ n - But if V — +oo, we cannot find an explicit form for 



the distribution function F(x) similar to that of Theorem 5.1, but we can 



use Theorem |5.2| . Indeed we have that the state A is ergodic if and only if 
either 3>a>2ora = 2 and j3 > 1, in which case Ei[I Aic(& n )] ~ n. For 
other values of a and /3, we know that E p [N n ] is an infinite of order less than 
n, and for Ei[lAic(& n )] we can apply Theorem ^73] to obtain an estimate for 
its order of infinite. 

Example 5.10. In a particular case, we can say something more about the 
order of infinite of E p [N n ] using the theory of recurrent events ( |l(| ) and of 
power series ([0). Indeed, choosing the sequence e^ ~ ^r^, we have that 

the distribution function F(x) ~ ( 1 — -^-^ ) . Then from the characterization 

of E p [N n ] in terms of the generating function of the random variables X^, we 
obtain that asymptotically E p [N n ] < n a for all a > 0. Hence, from Theorem 
1| Ei[lAic{& n )} is an infinite of order smaller than any power law. 



We have thus found that changing the sequence (e*.) it is possible to obtain 
all a set of behaviours for the mean of the AIC with respect to the Lebesgue 
measure. It is clear that the different behaviours are induced by the rate 
with which the derivative of the map L increases, rate that depends on the 
order with which (e*.) tends to 0. It is then evident that this must be also 
the criterion to distinguish between different behaviours of the information 
function of the Manneville map / for different values of the parameter z in 
equation (|I|). We have then to find a way to associate to a particular value of 
z a given sequence (e^). Since we have to maintain a given rate of increasing 
of the derivative, given a value for z, we look for the sequence (e^) such that 
£fc ~ %k, where Xk is the sequence of preimages of the point Xo, as defined in 
Section |]. 

We have that xt ~ 777 with a = -^-r. We are then in the first case we 
studied, and a > being z > 1. We can apply all the results we found, in 
particular: 

• if z < 2 then Ei[Ij\jc((T n )] ~ n and there is an L-invariant probability 
measure p, such that p(Ai) ~ -^-; 
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if z > 2 then n a < Ei[I Aic{°~ n )} < n a \og 2 n and the invariant measure 
fl is not a probability measure. 



We have then found as a particular case the same results of [[L3|]. But, we 
would like to have a behaviour of the AIC valid for almost any orbit with 
respect to the Lebesgue measure I. We have 

Theorem 5.11. For almost any point x G I with respect to the Lebesgue 
measure I and for all 5 > 0, we have that E lls [lAic(o~ n )] is asymptotically 
equivalent to Ei[lAic(°~ n )], where with fig we denote the measure given by the 
Lebesgue measure I concentrated on Us = (x — 5, x + 5). 

Proof. The proof is based on a simple application of the method we used 
before. Indeed, given x G I, let's consider Us = (x — 5, x + 5) for some 
5. If we now want to estimate the value of Es[N n ], that is the mean made 
with respect to the measure on Em induced by fis, we notice that, from the 
properties of the map L, it is clear that there exists a R(S) G N such that 
L R ^(Us) = [0, 1]. We can deduce that Es[N n ] is the same as E p [N n ], where 
p is the measure on Em induced by I, for n > R(5). Then it follows that 
E^[I AIC (a n )} ~ E l [I AIC {a n )\ for n > R(5). □ 

Corollary 5.12. The AIC of the Manneville map / is given by 

• n a < E^[I AIC (o n )} < n a log 2 n with a = ^, for z > 2; 

• E M [I AIC (o n )]~nfoTZ<2 

for almost any point x G I with respect to the Lebesgue measure I. 

We remark that there are points x G / for which lAic{% n ) ~ n a ls° f° r 
the Manneville map / with z > 2. Indeed, in Subsection pT2| , we proved 
the existence of /-invariant measures \i on (I, £>), for which the K-S entropy 
h^ s = log 2. This is not a contradiction since such measures have support 
on a set of zero Lebesgue measure. 

6 Conclusions 

In this paper we have proved that the Manneville map with z > 2 ([!]) exhibits, 
from the AIC point of view, a behaviour which is intermediate between the so- 
called full chaos (positive K-S entropy) and periodicity. Then we obtain that 
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the complexity (see Section [I], equations (^j)) of the Manneville map with z > 
2 is null for almost any initial condition with respect to the Lebesgue measure 
I and then the algorithmic entropy hi = (see Section [I], equations (|])). In 
particular we have found a family of piecewise linear maps L that, for fixed 
sequences e^ (see equation (|)), can be used as a model for the Manneville 
map. Moreover this family of maps presents a rich set of possible algorithmic 
behaviours (depending on the choice of the map L of the family). It is 
evident that changing the sequence e^, the algorithmic behaviour varies from 
full chaos to mild chaos, which is characterized by lAic(o~ n ) of order smaller 
than any power law. This behaviour can be achieved from the Manneville 
map at the limit z — > +00 (see Theorem |5.3| ), and Example |5.1C seems to 



suggest a way to find a particular sequence generating mild chaos. We remark 
that it would be impossible using the notions of complexity and algorithmic 
entropy to distinguish many of the maps of the family L, since we would 
obtain K(x) = hi = for almost every x G (1,13,1). Then the AIC is 
for those maps a powerful tool for the classification and it can be actually 
estimated. 

Finally we observe that it has been proved that the AIC of a string is 
not a computable function and, in particular, it cannot be computed by any 
algorithm (f|). Then, apart from particular dynamical systems for which we 
can estimate the AIC, the classification of dynamical systems using the AIC 
cannot be obtained explicitly. Nevertheless we believe that it is fundamental 
to obtain an explicit estimation of the AIC for as many dynamical systems 
as possible. However the AIC can be approximated by different notions of 
information content of a string. In particular we can define 

I A (a n ) = \A(a n )\, (18) 

the information function, where |v4(cr n )| is the binary length of the output 
obtained from a string a n by means of a compression algorithm A (see [|]]). 
A particular compression algorithm, called CASToRe, has been built to an- 
alyze dynamical systems which present rich dynamics, but having zero K-S 
entropy for all invariant measures that are physically relevant (@). The 
algorithm CASToRe has been tested on the Manneville map, giving as re- 
sult IcASToRe(o~ n ) ~ n° for a < 1, confirming our results (||, ||), and on 
the logistic map at the chaos threshold, giving the presence of mild chaos 
(||). At the moment it is not clear whether the algorithm CASToRe can 
approximate the AIC for any dynamical system, but from this paper on the 
Manneville map and from many experimental results on the logistic map, it 
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seems that at least in these two cases there is evidence of accordance between 
the theoretical predictions and the experiments with CASToRe. 
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